Markov Temporal Logic
نویسندگان
چکیده
Mostmodels of agents andmulti-agent systems include information about possible states of the system (that defines relations between states and and their external characteristics), and information about relationships between states. Qualitativemodels of this kind assign no numerical measures to these relationships. At the same time, quantitative models assume that the relationships are measurable, and provide numerical information about the degrees of relations. In this paper, we explore the analogies between somequalitative andquantitativemodels of agents/processes, especially those between transition systems andMarkovianmodels. Typical analysis of Markovian models of processes refers only to the expected utility that can be obtained by the process. On the other hand, modal logic offers a systematic approach to describing phenomena by combining various modal operators. Here, we try to exploit linguistic features, offered bypropositionalmodal logic, for analysis ofMarkov chains and Markov decision processes. To this end, we propose Markov temporal logic MTL– a multi-valued logic that extends the branching time logic CTL*.
منابع مشابه
Ha, Eun Young. Modeling Discourse Structure and Temporal Event Relations for Automated Document Summarization with Markov Logic Networks. (under the Direction of Modeling Discourse Structure and Temporal Event Relations for Automated Document Summarization with Markov Logic Networks
HA, EUN YOUNG. Modeling Discourse Structure and Temporal Event Relations for Automated Document Summarization with Markov Logic Networks. (Under the direction of James C. Lester.) Recent years have seen significant progress in natural language processing. A key challenge posed by many natural language applications ranging from text summarization to question answering and machine translation is ...
متن کاملA Temporal Logic for Stochastic Multi-Agent Systems
Typical analysis of Markovian models of processes refers only to the expected utility that can be obtained by the process. On the other hand, modal logic offers a systematic method of characterizing processes by combining various modal operators. A multivalued temporal logic for Markov chains and Markov decision processes has been recently proposed in [1]. Here, we discuss how it can be extende...
متن کاملTechnical Report: Distribution Temporal Logic: Combining Correctness with Quality of Estimation
We present a new temporal logic called Distribution Temporal Logic (DTL) defined over predicates of belief states and hidden states of partially observable systems. DTL can express properties involving uncertainty and likelihood that cannot be described by existing logics. A co-safe formulation of DTL is defined and algorithmic procedures are given for monitoring executions of a partially obser...
متن کاملTemporal Logic in a Stochastic Environment
Temporal logic has proved to be a useful tool for the speci cation of computer systems interacting with their environment Meanwhile a common approach to the analysis of the performance of such systems has been based on stochastic process theory and in particular Markov chains We describe an approach to modelling a temporal logic system in a random environment and how Markov Chain techniques can...
متن کاملProbably Approximately Correct MDP Learning and Control With Temporal Logic Constraints
We consider synthesis of controllers that maximize the probability of satisfying given temporal logic specifications in unknown, stochastic environments. We model the interaction between the system and its environment as a Markov decision process (MDP) with initially unknown transition probabilities. The solution we develop builds on the so-called model-based probably approximately correct Mark...
متن کاملExploring the Effectiveness of Lexical Ontologies for Modeling Temporal Relations with Markov Logic
Temporal analysis of events is a central problem in computational models of discourse. However, correctly recognizing temporal aspects of events poses serious challenges. This paper introduces a joint modeling framework and feature set for temporal analysis of events that utilizes Markov Logic. The feature set includes novel features derived from lexical ontologies. An evaluation suggests that ...
متن کامل